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Thanks  for  Reporting  your  Appraisal 
Results  to  the  SEI 


The  briefing  is  only  possible  due  to  the  cooperation  of 
organizations  and  individuals  sending  in  their  appraisal 
results  to  the  SEI 

Our  many  thanks  for  their  cooperation  with  our  data 
collection  and  analysis  efforts. 

The  SW-CMM  appraisals  sunset  is  Dec.  2005.  There  will 
be  no  more  update  available  in  the  future. 
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Outline 

Introduction 
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Community  Trends 
Organizational  Trends 
Summary 


This  briefing  is  based  solely  on  the  appraisals  reported  to  the  SEI.  It  cannot  be  used  as  a  source  for  an  exact  indicator  of  all 
organizations  in  the  world  using  SEI  models  or  appraisal  methods  nor  can  it  be  used  for  certification  or  verification  purposes. 

The  SEI  does  not  certify  organizations.  The  SEI  only  licenses  SEI  partners  and  SEI  authorized  lead  assessors  to  conduct  appraisals. 
Neither  the  SEI  nor  any  other  organization  is  a  “certifying  authority”  of  the  results  from  an  appraisal.  Therefore  requests  to  the  SEI  to 
provide  information  to  be  used  for  this  purpose  can  not  be  fulfilled.  Information  provided  by  the  SEI,  such  as  this  briefing,  is  to 
demonstrate  use  of  its  products  and  services  only. 

Organizations  performing  source  selection  or  verification  should  consider  performing  an  evaluation  appraisal.  For  more  information  on 
appraisal  methods  and  for  a  directory  of  authorized  lead  appraisers  who  can  perform  them,  visit: 
http://www.sei.cmu.edu/appraisal-program/ 
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Introduction  - 1 :  Purpose  and  Source 

Characterize  the  process  maturity  of  the  software  community 

This  briefing  uses  information  from  appraisals  using  the  SW- 
CMM  in: 

•  CMM®-Based  Appraisals  for  Internal  Process  Improvement 
(CBA  IPIs)  and 

•  Software  Process  Assessments  (SPAs)  and 

•  Standard  CMMI®  Appraisal  Method  for  Process 
Improvement  (SCAMPISM),  vl  .1 

Please  visit: 

http://www.sei.cmu.edu/appraisal-program/profile/about.html 

for  additional  information  or  to  answer  questions  you  may 
have  about  this  briefing 
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Introduction  -  2:  Briefing  Contents 

This  briefing  includes  three  primary  sections: 

1.  Current  Status 

-  Snapshot  of  the  software  community  based  on  the  most 
recent  appraisal,  since  2001,  of  reporting  organizations 

2.  Community  Trends 

-  Global  distribution  of  appraisals 

-  Growth  in  the  number  of  appraisals  performed 

-  Shifts  in  the  maturity  profile  over  time 

3.  Organizational  Trends 

-  Analysis  of  Key  Process  Area  (KPA)  satisfaction 

-  Time  to  move  up  in  maturity  based  on  change  in  maturity 
level  and  time  between  appraisals 
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Section  1 :  Current  Status 

Appraisals  conducted  from  2001  through  December  2005 
and  reported  to  the  SEI 

*  1,804  organizations 

*  996  participating  companies 

•  8,897  projects 

•  66.6%  Non-USA  organizations 


Please  refer  to:  Terms  Used  in  this  Report  on  page  30 
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Maturity  Profile 

by  All  Reporting  Organizations 

100%  j 

90%  -- 

80%  -- 

70%  - 

60%  - 

50%  - 


Initial  Repeatable  Defined  Managed  Optimizing 

Based  on  most  recent  appraisal,  since  2001,  of  1,804  organizations  reporting  a  maturity  level  rating 
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Reporting  Organization  Categories 


Commercial/ln-house 


80.9% 


DoD/Fed  Contractor 


Military/Federal 


16.1% 


3.0% 


0%  10%  20%  30%  40%  50% 


60%  70%  80%  90% 


%  of  Organizations 


— I 

100% 


Based  on  1,804  organizations  reporting  organization  categories 

©  2006  by  Carnegie  Mellon  University  March  2006 


Process  Maturity  Profile  -  Page  8 


%  of  Organizations 


Carnegie  Mellon 

Software  Engineering  Institute  Software  CMM  -  CBA  IPI,  SPA  and  SCAMPI  Appraisal  Results  * 

Maturity  Profile 

by  Reporting  Organization  Categories 

100%  -| 

90%  - 

80%  - 

70%  - 


Initial  Repeatable  Defined  Managed  Optimizing 

□  Commercial/ln-house  ■  DoD/Fed  Contractor  □  Military/Federal 

Based  on  most  recent  appraisal,  since  2001,  of  1,804  organizations  reporting  categories  and  a  maturity  level  rating 


©  2006  by  Carnegie  Mellon  University 


March  2006 


Process  Maturity  Profile  -  Page  9 


Carnegie  Mellon 

Software  Engineering  Institute 


Software  CMM  -  CBA  IPI,  SPA  and  SCAMPI  Appraisal  Results 


Organization  Type 

Based  on  Primary  Standard  Industrial  Classification  (SIC)  Code 


Construction 

0.2% 


Business  Services 
36.5% 


Engineering  &  Management 
Services 
10.0% 


Health  Services 
0.3% 


Wholesale  Trade 
0.6% 


Retail  Trade 


Transportation, 
Communication,  Electric,  Gas 
and  Sanitary  Services 
3.6% 


Public  Administration  (Including 
Defense) 

8.8% 


Other  Services 
0.2% 

Amusement  &  Recreation 
Services 
0.2% 


Transportation  Equipment 
6.5% 


Instruments  And  Related 
Products 
6.0% 


Finance,  Insurance  and  Real 
Estate 
15.1% 


Rubber  And  Misc  Plastics 
Products 
0.2% 


Furniture  And  Fixtures 
0.2% 

Printing  And  Publishing 
0.3% 


Chemicals  And  Allied  Products 
0.5% 


Fabricated  Metal  Products 
0.5% 

Primary  Metal  Industries 
0.6% 

Industrial  Machinery  And 
Equipment 
3.7% 


Based  on  617  organizations  reporting  SIC  code.  For  more  information  visit:  http://www.osha.gov/oshstats/sicser.html 
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Organization  Size 

Based  on  the  total  number  of  employees  within  the  area  of  the  organization  that  was  appraised 


9.9% 


Based  on  1,775  organizations  reporting  size  data 
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Maturity  Profile  by  Organization  Size 

Based  on  the  total  number  of  employees  within  the  area  of  the  organization  that  was  appraised 


Based  on  1,775  organizations  reporting  size  data  and  a  maturity  level  rating 
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USA  and  Non-USA 

Reporting  Organization  Categories 


%  of  Organizations 

Based  on  602  U.S.  organizations  and  1202  NorvUSA  organizations  reporting  organization  categories 
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Maturity  Profile  by  All  Reporting 
USA  and  Non-USA  Organizations 


100% 

90%  ” 

80%  -- 

70%  -- 

60%  ” 

50% 

40% 

30%  -- 

20%  - 

10%  - 

0% 


10.5% 


3.2% 


49.0% 


4- 


34.9% 


40.0% 


32.2%  I 


4- 


9.3% 


4.2% 


4- 


Initial  Repeatable  Defined 

□  USA  ■  Non-USA 


Managed 


12.6% 


4.2% 


Optimizing 


Based  on  602  U.S.  organizations  and  1202  Non-USA  organizations  reporting  categories  and  a  maturity  level  rating 
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Section  2:  Community  Trends 

CBA  IPIs  ,  SPAs  and  SCAMPI  vl.1  using  the  SW-CMM  conducted 
since  1987  through  December  2005  and  reported  to  the  SEI 


*  3,952  appraisals 

3,330  CBA  IPIs 
484  SPAs 
138  SCAMPIS 

*  3,049  organizations 

*  1,241  participating  companies 

*  704  reappraised  organizations 

*  16,540  projects 


Please  refer  to:  Terms  Used  in  this  Report  on  page  30 
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Countries  Where  Appraisals  have  been 
Performed  and  Reported  to  the  SEI 


Argentina 

Australia 

Austria 

Barbados 

Belgium 

Brazil 

Canada 

Chile 

China 

Colombia 

Costa  Rica  Cyprus 

Czech  Republic  Denmark 

Egypt 

Finland 

France 

Germany 

Greece 

Hong  Kong 

Hungary 

India 

Indonesia 

Ireland 

Israel 

Italy 

Japan 

Korea,  Republic  of 

Latvia 

Lithuania 

Malaysia 

Mauritius 

Mexico 

Morocco 

Netherlands 

New  Zealand 

Norway 

Pakistan 

Peru 

Philippines 

Poland 

Portugal 

Puerto  Rico 

Russia 

Saudi  Arabia  Singapore 

South  Africa  Spain 

Sri  Lanka 

Sweden 

Switzerland 

Taiwan 

Thailand 

Turkey 

Ukraine 

United  Arab  Emirates 

United  Kingdom  United  States  Uruguay  Venezuela  Vietnam 
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Number  of  Appraisals  and  Maturity  Levels 
Reported  to  the  SEI  by  Country 


Country 

Number  of 
Appraisals 

Maturity 
Level  1 
Reported 

Maturity 
Level  2 
Reported 

Maturity 
Level  3 
Reported 

Maturity 
Level  4 
Reported 

Maturity 
Level  5 
Reported 

Country 

Number  of 
Appraisals 

Maturity 
Level  1 
Reported 

Maturity 
Level  2 
Reported 

Maturity 
Level  3 
Reported 

Maturity 
Level  4 
Reported 

Maturity 
Level  5 
Reported 

Argentina 

12 

No 

Yes 

Yes 

No 

Yes 

Mauritius 

1 0  or  fewer 

Australia 

&6 

Yes 

Yes 

Yes 

No 

Yes 

Mexico 

*34 

Yes 

Yes 

Yes 

Yes 

Yes 

Austria 

1 0  or  fewer 

Morocco 

1 0  or  fewer 

Barbados 

1 0  or  fewer 

Netherlands 

w 

25 

Yes 

Yes 

Yes 

No 

Yes 

Belgium 

r 

17 

Yes 

Yes 

Yes 

No 

No 

New  Zealand 

1 0  or  fewer 

Brazil 

f 

32 

Yes 

Yes 

Yes 

Yes 

Yes 

Norway 

1 0  or  fewer 

Canada 

f 

85 

Yes 

Yes 

Yes 

Yes 

Yes 

Pakistan 

1 0  or  fewer 

Chile 

f 

29 

Yes 

Yes 

Yes 

No 

Yes 

Peru 

1 0  or  fewer 

China 

354 

Yes 

Yes 

Yes 

Yes 

Yes 

Philippines 

V 

13 

No 

Yes 

Yes 

No 

Yes 

Colombia 

1 0  or  fewer 

Poland 

1 0  or  fewer 

Costa  Rica 

1 0  or  fewer 

Portugal 

10  or  fewer 

Cyprus 

1 0  or  fewer 

Puerto  Rico 

1 0  or  fewer 

Czech  Republic 

1 0  or  fewer 

Russia 

1 0  or  fewer 

Denmark 

1 0  or  fewer 

Saudi  Arabia 

1 0  or  fewer 

Egypt 

1 0  or  fewer 

Singapore 

^23 

Yes 

Yes 

Yes 

No 

Yes 

Finland 

1 0  or  fewer 

South  Africa 

1 0  or  fewer 

France 

*151 

Yes 

Yes 

Yes 

Yes 

Yes 

Spain 

^28 

No 

Yes 

Yes 

Yes 

Yes 

Germany 

r76 

Yes 

Yes 

Yes 

Yes 

No 

Sri  Lanka 

1 0  or  fewer 

Greece 

1 0  or  fewer 

Sweden 

1 0  or  fewer 

Hong  Kong 

r12 

Yes 

Yes 

Yes 

Yes 

No 

Switzerland 

1 0  or  fewer 

Hungary 

1 0  or  fewer 

Taiwan 

1 0  or  fewer 

India 

r422 

Yes 

Yes 

Yes 

Yes 

Yes 

Thailand 

r23 

Yes 

Yes 

Yes 

No 

No 

Indonesia 

1 0  or  fewer 

Turkey 

10  or  fewer 

Ireland 

Yes 

Yes 

Yes 

No 

No 

Ukraine 

1 0  or  fewer 

Israel 

r 

32 

Yes 

Yes 

Yes 

No 

No 

United  Arab 

Emirates 

1 0  or  fewer 

Italy 

r 

40 

Yes 

Yes 

Yes 

No 

Yes 

United  Kingdom 

"l44 

Yes 

Yes 

Yes 

No 

No 

Japan 

V 

177 

Yes 

Yes 

Yes 

Yes 

Yes 

United  States 

2035 

Yes 

Yes 

Yes 

Yes 

Yes 

Korea,  Republic  of 

r 

78 

Yes 

Yes 

Yes 

Yes 

Yes 

Uruguay 

10  or  fewer 

Latvia 

1 0  or  fewer 

Venezuela 

1 0  or  fewer 

Lithuania 

1 0  or  fewer 

Vietnam 

1 0  or  fewer 

Malaysia 

1 0  or  fewer 

The  organization  maturity  profile,  page  6,  can  be  created  for  certain  countries  using  the  Interactive  Maturity  Profile  available 
in  the  Software  Engineering  Information  Repository  Web  site.  Please  visit:  http://seir.sei.cmu.edu.  If  you  are  not  already  a 
member  of  the  SEIR  web  site,  please  register  to  join.  Registration  and  use  of  the  site  are  free. 
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Number  of  SW-CMM  Appraisals  Reported  to 
the  SEI  by  Year 


■  First  Appraisal  □  Reappraisal 


Based  on  3,952  appraisals  conducted  through  Dec  2005  and  reported  to  the  SEI 


©  2006  by  Carnegie  Mellon  University 


March  2006 


Process  Maturity  Profile  -  Page  18 


Carnegie  Mellon 

Software  Engineering  Institute 


Software  CMM  -  CBA  IPI,  SPA  and  SCAMPI  Appraisal  Results  * 


Number  of  SW-CMM  Appraisals  Reported 
to  the  SEI  by  Organization  Categories  and 
Year 


□  Commercial/In-house  ■  DoD/Fed  Contractor  □  Military/Federal 

Based  on  3,950  appraisals  reporting  organization  categories 
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Trends  in  the  Community  Maturity  Profile 


100%  -I 

90%  - 


Initial  Repeatable 


Year 

Orgs 

□  1987-1991 

132 

■  1992-1996 

635 

□  1997-2001 

1,660 

□  2002 

1,998 

■  2003 

2,423 

□  2004 

2,772 

□  2005 

3,049 

Defined  Managed  Optimizing 


Based  on  a  cumulative  view  of  the  most  recent  appraisals  of  organizations  up  through  the  year  indicated. 
This  accounts  for  the  difference  from  the  figures  on  page  5. 
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Section  3:  Organizational  Trends 

Appraisals  conducted  through  December  2005  and  reported  to 
the  SEI 

•  1,956  Key  Process  Area  (KPA)  profiles 

-  satisfaction  of  KPAs  by  maturity  level  for  organizations 
appraised  at  levels  1  and  2 

•  704  reappraised  organizations 

-  accounting  for  1,617  appraisals 

-  although  some  organizations  conducted  multiple 
reappraisals,  only  the  first  and  latest  appraisals  were  used 
in  creating  the  charts  on  pages  23  &  24 


Please  refer  to:  Terms  Used  in  this  Report  on  page  30 
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Key  Process  Area  Profiles  - 1 
Organizations  Appraised  at  Level  1 


Repeatable 


Defined 

OPF 

OPD 

TP 

ISM 

SPE 

1C 

PR 

Managed 

QPM 

SQM 

Optimizing 


%  of  Appraisals 

Based  on  582  CBA  IPI  and  SCAMPI  with  SW-CMM  appraisals  reporting  a  maturity  level  rating 
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Key  Process  Area  Profiles  -  2 
Organizations  Appraised  at  Level  2 


%  of  Appraisals 

Based  on  1374  CBA  IPI  and  SCAMPI  With  SW-CMM  appraisals  reporting  a  maturity  level  rating 
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Maturity  Level  of 
First  and  Latest  Appraisal 


100% 


90% 


80% 


(0  70% 

c 

o 

CB  60% 


c 

§)  50% 


Initial  Repeatable  Defined  Managed 

□  First  B  Latest 

Based  on  704  reappraised  organizations  using  their  first  and  latest  appraisal 


16.9% 
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Reappraisals 
Change  in  Maturity  Level 


Level  4  to  5 
7.0% 


Level  3  to  5 
5.5% 


Moved  Down 
2.8% 


Level  3  to  4 
3.1% 


Level  2  to  5 
2.7% 


Level  2  to  4 
3.6% 


No  Change 

12.5% 

Level  1  to  1 

5.1% 

Level  2  to  2 

4.4% 

Level  3  to  3 

1.8% 

Level  4  to  4 

0.4% 

Level  5  to  5 

0.7% 

Level  1  to  5 
1.0% 


Level  1  to  4 
1.8% 


Based  on  704  reappraised  organizations  using  their  first  and  latest  appraisal 
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Time  to  Move  Up 


Level  1  to  2  2  to  3  1  to  2  2  to  3  3  to  4  4  to  5  1  to  2  2  to  3  3  to  4  4  to  5 

Orgs  25  12  175  262  63  64  200  274  65  64 
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Summary  of  Current  Status 


Commercial  and  in-house  organizations  reported  most 
appraisals 

Of  U.S.  organizations,  the  services  and  manufacturing 
industries  reported  most  appraisals 

Over  half  of  the  organizations  reporting  size  have  100  or 
fewer  software  personnel 

More  Non-USA  appraisals  reported  than  U.S.  in  this  5  year 
snapshot 
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Summary  of  Organizational  Trends  - 1 


The  number  of  SW-CMM  appraisals  steadily  declined  during  the 
two  years  sunset  period  (2004-2005)  while  CMMI  SCAMPI 
appraisals  have  been  rapidly  increased  (See  Process  Maturity 
Profile  for  CMMI  VI  .1) 


NO  SW-CMM  appraisals  have  been  reported  since  Dec.  2005 


Software  Subcontract  Management  is  the  least  frequently 
satisfied  level  2  KPA  among  organizations  appraised  at  level  1 

Integrated  Software  Management  is  the  least  frequently  satisfied 
level  3  KPA  among  organizations  appraised  at  level  2 

Higher  maturity  has  been  reached  among  those  organizations 
reporting  reappraisals 
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Summary  of  Organizational  Trends 

(continued)  -  2 

For  organizations  that  began  their  CMM-based  SPI  effort  in 
1992  or  later,  the  median  time  to  move  from: 

•  maturity  level  1  to  2  is  19  months 

•  maturity  level  2  to  3  is  19  months 

•  maturity  level  3  to  4  is  24  months 

•  maturity  level  4  to  5  is  13  months 


Note: 

Since  the  September  2005  report,  the  median  time  to  move  from  maturity  level  2  to  3  dropped  from  20  month 
to  19  month  and  the  median  time  to  move  from  maturity  level  3  to  4  dropped  from  25  month  to  24  month. 
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Terms  Used  in  this  Report 

Appraisal  -  The  appraisal  methods  used  in  this  report  are  the  Software  Process 

Assessment  (SPA),  CMM-Based  Appraisal  for  both  Internal 
Process  Improvement  (CBA  IPI)  and  Standard  CMMI®  Appraisal 
Method  for  Process  Improvement  (SCAMPI).  We  do  request  and 
receive  other  Software  CMM-based  appraisals  such  as  Software 
Capability  Evaluations  (SCE)  and  Interim  Profiles.  As  our  sampling 
size  of  these  other  methods  increase,  they  will  be  reported  here. 

Company  -  Parent  of  the  appraised  entity 

A  company  can  be  a  commercial  or  non-commercial  firm,  for-profit 
or  not  for-profit  business,  a  research  and  development  unit,  a  higher 
education  unit,  a  government  agency,  or  branch  of  service,  etc. 

Organization  -  a.k.a.  Appraised  entity 

The  organization  unit  to  which  the  appraisal  results  apply.  An 
appraised  entity  can  be  the  entire  company,  a  selected  business 
unit,  units  supporting  a  particular  product  line  or  service,  etc. 

Non-USA  -  Appraised  entity  whose  geographic  location  is  not  within  the  United 

States.  The  parent  of  the  appraised  entity  may  or  may  not  be  based 
within  the  United  States. 
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Contact  Information 

Please  visit: 

http://www.sei.cmu.edu/appraisal-program/profile/about.html 


and  review  the  information  provided  before  contacting: 

SEI  Customer  Relations  (41 2)  268-5800 

SEI  FAX  number  (412)  268-5758 

Internet  Address 
customer-relations@sei.cmu.edu 

Mailing  Address 
Customer  Relations 
Software  Engineering  Institute 
Carnegie  Mellon  University 
Pittsburgh,  PA  15213-3890 


©  2006  by  Carnegie  Mellon  University 


March  2006 


Process  Maturity  Profile  -  Page  31 


